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(54) DEVICE AND METHOD FOR INFORMATION PROCESSING AND PROVIDING MEDIUM 

(57)Abstract: 

PROBLEM TO BE SOLVED: To simply and surely input a 
prescribed command to a personal computer. 
SOLUTION: A CCD video camera picks up characters 
displayed on a prescribed object and overlaps and 

displays recognized results 252 obtained as a result of mm^i^^ 



performing character recognition of the picked up image 
on an object image displaying part 241. An extraction 
frame 251 showing the range of image data utilized for 
the recognition is shown in the neighborhood of the 
results 252. Thus, it is possible for a user to intuitively 
grasp which part is extracted from the entire image 
being a recognition object to obtain the recognized 
results. 
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[0018] At the front of the display section 3, LCD (Liquid 
Crystal Display) 21 is disposed, and on its upper end portion, 
an image pickup section 22 is disposed in a freely rotating 
manner with respect to the display section 3. That is, this 
image pickup section 22 is configured to be able to rotate to 
an arbitrary position within the range of 180 degree between 
a direction identical to LCD 21 and a direction opposite to 
it (back face direction) . A CCD video camera 23 is attached 
to the image pickup section 22. 



[0045] At Step S4, the finder application 54C judges whether 
or not a user specified a character region. In the case where 
the character region is not specified, the process advances 
to Step S5, and the finder application 54C extracts a 
predetermined range in an image of one frame component stored 
in RAM 54, as a character region. Then, at Step S6, the finder 
application 54C transfers image data in the extracted 
character region to the character recognition engine 8 9 to have 
it recognized characters. The character recognition engine 
89 has stored a wide variety of character patterns in advance, 
and compares the patterns with the image data within the range 
of the transferred character region, and recognizes whether 
or not a character is included therein. Then, the character 
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recognition engine 8 9 outputs the recognition result 
(character) to the finder application 54C. 

[0046] In this manner, usually, the finder application 54C 
executes continuously the character recognition processing to 
an image of each frame, but it is also possible to specify a 
character region by a user operating the track point 5 etc. 
In the case where the user specified a character region, 
processing of Step S5 is skipped, and within the range of the 
specified character region, the character recognition engine 
89 executes the character recognition processing. 
[0047] At Step S7, the finder application 54C judges whether 
or not a character was recognized, on the basis of the output 
of the character recognition engine 89, and in the case where 
it is not recognized, the process returns to Step S2, and 
processing starting from the step is executed repeatedly. 
[0048] At Step S7, in the case where it was judged that a 
character was recognized, the process advances to Step S8, and 
the finder application 54C displays a frame indicating the 
range of the character region in which a character was detected 
on GUI. That is, at this time, the finder application 54C 
controls the graphic chip 81 to display the character region 
in which a character was recognized, on the target image display 
section 241 of GUI, by means of the extraction frame 251. By 
this means, a user can know that a character was recognized 
from an image in which region. Furthermore, at Step S9, the 
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finder application 54C displays the character recognition 
result (character) 252 supplied from the character recognition 
engine 8.2 under the extraction frame 251. Meanwhile, at this 
time, in the case where plural candidates exist as the character 
recognition result, the candidates are displayed at the same 
time. A user selects a correct character from among the 
character recognition result 252 by operating the track point 
5 etc., and in the case where one correct character has been 
already displayed, a user carries out an input operation for 
fixing the recognition result. In the vicinity of the 
character recognition result 252, the extraction frame 251 for 
indicating a range in which it was recognized is displayed, 
and therefore, a user can judge whether or not the recognition 
result is correct, promptly and surely. 



[0052] The finder application 544C further judges, at Step S13, 
whether or not a predetermined one was selected from among the 
character recognition result displayed on the recognition 
history display section 242. That is, a user can select a 
predetermined one from among characters displayed on the 
recognition history display section 242 by operating the track 
point 5 etc. When a predetermined character was selected, the 
finder application 54C executes, at Step S14, processing 
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corresponding to the selected character. 

[0053] For example, the finder application 54C judges, if the 
selected character string is a character string beginning by 
"http://", that it is URL (Uniform Resource Locator), and 
activates the Internet browser program 56E to have it accessed 
the URL. In the case where the selected character string is. 
a character string separated by "@" and it judges that 

it is an electronic mail address, and the finder application 
54C activates the electronic mail program 56D, sets that 
electronic mail address, and carries out preparation of mail 
transmission . 
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[0002] 

10 <©^^H ; (c J tS:UT^5o 

[0 0 0 3] mitts K©0!&*L-CV5. r 

©fiKcfeV^Ts =»— K7^V5 0 OKltt, 3— KSP 
5 0 1 ©T^©^*^ 5 0 2 ^**$tvT^5^iSc 
3- KSP5 0 1 (M&<DU 

[0 0 0 4] t'5"e, /J-3-K7^^ ^ 
20 -KSrSn^S^ lo©*St VX, tV^-*^ 91- i 15 

[0 0 0 5] ZZX\ ^-Yfc£tiZ>^m^<teitc 

ij%1-J:54-t^ 2^S^lc|S?iJ$n 
fc2*^-=>-K^, f^^tuT^So rtutcj;^ 
tf % If 2ft7nW(C=t- K-fb^HS^ t =fc 9 , ±>9# 

30 < ©lf$g*Sr=3 - v\k-fz> rtm, 1 

if f Jt* ^ 7 ± 5 m&m 9 ifima t#z. 

[0 00 6] 

5 Tin— K/<^-y|fi!)Iftt$3Kilt^ifc?) 

40 [0007] tfc, #M¥9-289624f« 
tts fi/^^W 7iC0CR (Optical Character Reade 
r) ^^^-CStO^^iS^^tWMI 

[0008] u*»bfta«bx i:*B«»^-f bt#»c]E 
[0009] <d i 5 ft*ta^fi*"cft$^ 
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mt^-t 5&mmMi&7Ft[!M* 1 ryzfi: fc-^fr&a* 30 

[ooi3] i tzvmniimse&mm* »#E5 

[0 0 14] 

3 0 r©/<— y^aS'tr*— * i tt % *=y— hi!© 

/VytA'ayifa- K*6t)fc, *^2t, 
##2lC#LTi!Hg£fc£;tVtV^^$3fc£!3#| 

tt\sxm^tz$m<ow-mm. isii 3***2 

l£MLT$^Lfcft&*^1-;fc«ffl§I, H6tt, 

g(5 3***2{C*|-LTl 8 0SWV^fc««Sr*^*fl!l«!l 

©EffiEk H8I1 ^$3***2&C*fLTlW^fc:fc 50 
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[0 0 15] **2}cf± N #a©X*^E-S-ft^SrA* 
1-5^t*^^n5^-#-K4s -r?*#-y;v*# 
|b$ii:5i:#££K:&#£ft3 h5y^Wvl> (j& 
40 5i>K Z<D±.mz.mVbtiX^Z 0 **2© 
±ffi(cf±, ^*ffi;*r>-5*h?-;&8i:, 3c*gB3}dRl7 
fettTv^ccDtr'x^y 7 2 3 -eltirf 3 itlft^'S 

[0 0 16] «S«3©±»«l:it l SsWRW-b 
*vt*i9, H5}c:^-rJ:5i-, **»3***2fc*|-L 

«- -5**2^1, yy i 3ds«^t-*7L«is6*«Rw-e>n 

T^5„ **2©fu®fc«, * 7 -f KW<— 7 ^luffit 
¥1ffc5g«ftBrtBtcR»te>nt:*5*). *7^ Kw<-7fi 
?L^6{C&^Lfcvy 1 3 i^LTPy^U 4fco 
y ^t&X% 5 X 5 fcfco-O^a. n y * * 

3***2 (C» LT @IH- 
5ii*5Tfta. 7^ 1 3©P<5{rft, -r-i'^n*^2 
4*s^«?#Jt?)ixTV , >5 0 rcD-r^^o*>2 414, El 

[0 0 17] **2©IEffiScf44fc, -fnyj-rffr* 
y-*- (PPK) 9^RJte>HTV^5o **2©^{Slffi 

fctt, 0 e iZTH-ti. o sc. swsa 1 1 tm-f btixx 

t), #flc2©fl&BTfflfc:ttu I8 7t*-r J:5fc» 

f± % PQ1CIA (Personal Comuputer Memory Card Interna 
tional Association) K (PC*— K) *#A1"5 

[0018] «*tt.3 oEiBiiitt; mkSratss-fSLCD 

(Liquid Crystal Display) 2 1 ^Rtt fettTfct) , * 
<D±iB«^tt, flMfclS 2 2 3 L-C0S) g 

lE»tRltfe*fCV^-5. r©Ji«2 2{4, LC 

D2 1 iPl-©*Sli, ^©i$©^[Bl (WffiO^lPl) 

©BB©1 8 omoffcffln&moQLfflzmWii-ZZ.b&X' 

t5±5^**nT^5. iWfeSB2 2fctt, CCDt'r^" 
*p<7 2 3^9#tt6>ttT^5 0 
[0 0 19] 3 ©TWO*#:«fctt^ M^7>-7° 

pu mtkyyfBU ^yt-^yyfyL, ^<d^<dub 

X9teZ>7>-7&m\-fbiriX\i^5o 05lc*-f^ 
^4 011 **2©fejS!l®icRttbttfcmM^-l' 7ft 
07 \Z.^-fn%- 2 5 f±, CCD If 7** t 7 2 3 © 

^^f^F# 2 6 tt, ** 2 mcmm* * y *jr 9 

fc»©Hq«*ttiK1-«*-e*)9x ft4it±, ^2 6 
<T>uy>7V* TkPrt"k- * © tf y A"f 5 /hf L"C fc 5 » 
[0 0 2 0] 0 9(t /■«— yf;V3>fa-^ 1 <DfaM 
©#J*WSr*U-CV^5. rtSR^^5 1 fctt, CPU (Centr 
al Processing Unit) 5 2, f&SJCj6Ut:#A*ft5PC 
* — K 5 3, RAM (Random Access Memory) 5 4 , & j; 
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5 1 it, ^SB/<7 5 5 tcflBRSft-Os <9 , fl^7 
5 5{C(i, /n-KtV** K?>f7* (HDD) 5 6, I/O 
(Affi73) 3>Kn-?5 7, df— K=vhu— 9 
58, Yyy^^^V^^Y^-y 5 9, -r^Kx 
7^6 0, LCD=^ Fn- 7 8 3, tfASOf^ 

[0 0 2 1] CPU 5 2I±, «-«IBS:ttiei-«=»^hn- 

7t^0, pc*- K 5 3 f± N a yom&ZtfMi- 

[0 0 2 2] /?7-fy^fy/8 1 fctt* CCDfc'-r^ 
* ^ 7 2 3 9 8 2 "CM 

lit. MSgP8 2Sr^LTCCDtr'f f ^^ 
7 2 3 i 19 Ati&hfrt°T*y i —?%, F*g/i-f3VRAM8 
lAKBItU 3fS, rttSrHE^fflb-C, LCD^^ha 
-7 8 3{dffi73-r5 0 LCD=jy hn-7 8 3f4 % ^77 
4 y9?-y-f% 1 £t>«i&£ftfcWi>T-*£LCD2 1 
fctttfjU /<y*9>f h 8 Ait, LCD 2 1 

Sr«* , *»bMI9i"SJ:5fcft$HT^5. 20 
[0 0 2 3] RAMS 4© c NCfi, fiffil^^T Lfe^lC 
fel^T, M^fc£> OS (Operating System) (^7°n^ 
7 A) 5 4A, ^-h/^Py^n^7A (T7°!J7- 
—>3 ^7°n7*7i>.) 5 4B, f LT77^^77°!J 
-7--v-a^ (77'!)7—>3^7'P^7A) 5 4C& 
t\ j9r&©fe©d<* HDD5 6^f,i|Ei££}V iEttSfr 
<5<> 

[0 0 2 4] OS (1*7"P^7AV7 Vv*T) 5 4A 
f±, Windows98 (MM) Kft^SftS* =>^h°rr— 

[00 2 5] ir~ by<4n y Yy°n JfyJi.5 4B!4, f 

[0 0 2 6] 77'f^77'!)^-'>3>S4Cti; CC 
Dl^ft*^5 2 3^i b^fc®^SryT^^A-e§ 

tt& ^ x ©a*© 2 ah tata t x^mi&ttuti&m. 

[0 0 2 7] fl^7 5 5 ffl©^- Kx >f 7 7 K 

tVT" (HDD) 5 6iCtt, OS (!*7*P^7Ay7f7 
i7) 5 6 A. t-F/^Cyl«7*n^7A5 6B, *5 
i #7 7 W V 7° JJ 7— ~> 3 V 5 6 C a$|Btt $ ftt V * 

[00 2 8] s>— Ktm 7 * K7-T -7 5 6 tC»\ CI© 
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!7f7*P!/7A5 6 E, 17- K7°o-fe?/f-7 0 o^7A5 
6F, Sf?-7°D^7A5 6G^if©T7°y-7— v/3 >-7° 

[00 29] n,l-?>-->vy°utfyJ»<5 6DI1 

S1-57°D^7AT-fc5„ ^-;V7*P^7A5 6D 

Lt t -;Wf y 7 X 9 3 Art tC &© 
^-yvaMffi fcv»5d»if 5d»*flW8Uf^ i^jS©^ 
-/i^s *>fttfSef#-f ^ ^a* mtt 3 = 
[00 3 0] <4i/9—*y Yy°yy*?y°v?yJ*5 6E 

7* (MO ©J:5fc, -fV?-*y N9 2^LT, ffi 

©it is&ajge t mm -r sfMBSrHtn - *. 

[0 0 3 1] y-K7 , B'tyt7 , P^7A5 6Fli, 0» 
xff, -*» (ffitO s 17 -K (jffflD 4£©*5fc> 
H;£f§fc<5Wi3l!§&.!f'©I7 — K7°n-fe7.MaSr^ : fT"f 
5. Sf?7°a^7A5 6Gti, B#R£^l§fc, *>5V 

[0 0 3 2] 1/03^ Fn- x5 7 it, W^P^y)- 
o— 76lSr^rU IO-7-f?D3yFP- 76 llctt 
I/0-fy^7^6 2iSR»te>*l"Cl^S. r©-7-f^7 
P3y(>a-76 1 lWy^7i- 7, 6 2, CPU 6 
3, RAM6 4 N R0M6 9aSffiEJdS§ttSiXT*jft**VTV^ 
5o w©RAM6 4(±, ^r— ^737x^^71/^7.^ 6 
5, LED m%¥4ir- K) Mtpu^^6 6, K^i* 
^1/^7^6 7, 1/^7^6 8 Sr^TfCV^. R^^J 
1^7*6 7 tt, a.— ifjJS^feRJfeUfcllWa 
#) ffi»?<^^^«HtP» 7 6 ©»f^*H*&$ 

»ff .GBtt*fr) «t> Eiii-r^tTT" 

i;-r-^3>-7'a7°7A©^§r|Eli1-5 , b©T\ -t© 
fS'l$tvfc^^-©ia^.-g-fc-y:^3--f : ^ < t t» A7J$ 
^5<^s ^©FB'l$nfcT7°y7— ->3V7°p^7A 
(«ttfl^-^ti^7AS6D) *SiEI!i$n*w 

[0 0 3 3] ^-A7J77^^7We?7^ 6 5(±, !7^ 
^ 7f MO/p ^7?7yMl7^^- (PPK) 9 A* 

VS. LEDfWftW'^^ 6 6 1/^7^ 6 8 (CE'it^ 

ttfcT^iJ-r- ~>3 yy°v?yJ>. (MFf-t—fry'uify 
A56D) ©^rflR»***i-5^y-fe-3?9V7U 
©^«-*SI#P1-5t>©tf*)S. ^^V-^^6 7 

So 

[0 0 3 4] **5 % ^(O^^^nny 6 1 }Cfi 

^^6 5, 6 6, 6 7<DVti* 2 (DWKiifi*? t 
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[0 0 3 5] ?^^P3y|>P-7 6 1 F*3©R0M6 9© 

^n^7A7 1, LEDfSlJ#P7°n7~7A7 27j^ft&$i£ 
*LtV5. r<DR0M6 9tt, WfctfEEPROM (electricall 
y erasable and programmable read only memory) Xffl 
$£;ft/C^5o w©EEPR0lir±7 7yV3.^*JJ irfcPfti 
ftT^-So $blCv^^0 3yhP-7 6 1tlt M 
U&BZMZZVy M-5RTC (Real-Time Clock) 7 5 7)* 

[0 0 3 6] R0M6 W^OV^J 9TV7~7n?-7J>> 
7 0 tt, RTC 7 5^ bfc&£ft%%&1$M J f—S r \Z&5 
I^T, RIBS*! 1^**6 7}C^&^£$ftfcBf£iJK& 

n^7Afl)5. ^A*ta^^7A7 1tt, PPK 
^7At*5„ LEDfM"?7*i3 ^?A7 2li, ^ 

[0 0 3 7] ROM 6 9l£f±, £?>}CBI0S (Basic Input/0 20 
utput System) 7 3 ^St&SftTV^,, ;i©BI0S£ 

imv (Affi#) SrS!l^t5y7b!7 I 7^P^7^ 

[0 0 3 8] ^gfl^* 5 5(C^$tuTl/^^f-#- K 

p— ;vi-5 0 h^y^^l' t>3> 9tt h7 

ytWS V5(DAf3*mmiTZ>6 30 
[0 0 3 9] 0f± % 7#p*>24 

[0040] 5 0 f±> ^*HgI3ii 90, -f V* 

— *y hf— f^7°o^-f ^*9 ISttTLT, 4^9—* 
y h*oM*y 9 2^-/H-^9 3(ffc 

[0041] ttK^W 0 fi, llSrtyJfclJt 

9i$.9-y\ 0tf*mvVtmz&*itck% *>£ft, 40 

27)5 i 8 OSEHEilFftfcit (CCDf'r>7>^ 7 2 3^L 
CD2 10S5t«*lMft-f-«*fiIfclertii*nfci:t) , * 

[0 0 4 2] tW^ #&9i<D<*—yi~A'=ii'\£a.—*l 
\C^X, 7 7-1 ^^T7°y<7— >3>-5 4C7j5^ff$ 
tifcW&O&m^^XWLWt Z>„ r©7 7^>yT7° 
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t*^5A-H©t^^ Mll^ CCD if 
x^-7J^7 2 3i?ltt5; fctf, ^-yt;>nytfa 

U-7-— e/ 3 ^5 4c©^a{cov»Ts hi lis J; ifBii 

[0 0 4 3] fS)(^7 5'7°S lfCfc^T, 7T4>y 
T^ytr—i/B y5 4Cli, ^77^ y7f->78 1 £ 
ftfPPU GUI (Graphical User Interface) £fft$U 
**S*5o ^77^y^fy78 1ll, 7 7 ^^7 
7°y-7-— >3y5 4C^fc©^^jSb-Cs GUI©® 
^X-^^^U VRAM 8 1 A|c38lrt5o VRAM 8 1A 
©M#7 - * tt-t £ tfci § *K LCD=>yhD-7 

8 3&?>L-Cs LCD2 1 fCttJTJ^^ *^£tl£o -ft 
icj; 19. Wittf H 1 3l^f±5! F j;77^^77y7 
— v-a y©GUI^LCD2 l(C^$ft5„ r©GUI|C*SV> 
Tfi, CCDt'7^77^7 2 3*SKMfcbfclBlfeSr**i"5 
Jt*B«t**» 2 4 1 1 , * <£ 5 UT**W» 
^v>y 8 9 }c i 9 **WM*fc SftfclSfcOJWl&ft 
&i-ZmWMM^U2 4 27j^lt^ftT^5„ 

[0 0 4 4] WCX7 L 77°S 2tC*5Vvr, 77^f>^7 
7° !J -T— v- CCDlf-r^-77 ^723 (it) 

AttftKtt, ^© K7-1 ^) 7> £>BM£7-* SrStiT L7t 

XftW&Zo Wfc^-^fcSflrbfc*^ ^fy7"S3 
&&GUI_klC^&i2:3 0 iP*K CCDfc'7^-77^7 2 3K 

x vatoztiit^rys** hi i i©wfcn, ^sass 

7°8 1lC^$ft5„ ^77^7^^77*8 1^ 
®^7— VRAM 8 1 A(DGUI©*| i *®#^a5 2 4 1 
}C*rjE&1-5g|5^'CiS®i-5. ^ ©VRAM 8 lAtJU^tl 
XV^5®'^7 ^ -^^^^ii$^^^ LCD=>^hn-78 3 
Srj>LT, UV2 Hcm^&ti%<DX\ mi3\c^iri. 
0 }C % M^®^*SI5 2 4 1 iCCCDfc'7^77 ^ 7 2 3 X 
JHfebfcH«^»W*tLT**$il«. CCD If 

7^-77 ^723 bfcpf^©7-^(i, X^ii© 

±fr<DW$. iX^ffim ^tttU-t^fcfc^ RAM 5 4 }C 

[0 0 4 5] ^777*S4^*5VN-C, 77-f^77!J 
7-v- 3 ^ 5 4 C ft, a— 7tr i 5 S*l 

tdfi, ^777°S5iCit^ 77^^yT7 0 JJ'r— i/3 
y5 4C(±, RAM5 4(C|B'li$tir^5 1 7L— i^© 

m^© 5 *,©3f^©*Sffl^5:*ffi^^ ^ 
3 y5 4Cfc tttti $ tlfc^ffl^©H*7-^ 
iy^8 9iis ^-a©S:^©^^->-^fcE1iL-c 

*J!9, ^©/<^-^tfeii$ftTt7t^ffi^©|5H© 



9 

-rs. 

[0 046] r©«fc5fc:, 3Mf, 77^V^"T7°y^- 
h 5 ft ££SMFf-5 £ t T\ ^««*»J&t« -ifc 

[0 0 4 7] ^XS/T'S 7H*5Wr^ 77-^^7^5 

[0 0 4 8] ^fy7"S 7}Cfc^T, 

j^©$6fflSr^i"#%Gunc^$^r5 0 BP*>, r©i 20 
?f y/8 1 SrflMiPU GUIO^WIfe^lfP 2 4 1 ft 

^S9{C*5^T, 77^^77"!)^-i/3y5 4C 

2 5 2%, mBiW2 5 1 ©TfcfS*S*5. ft 
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